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TECHNICAL FIELD 

[0001] This invention relates to content accessibility and, in particular, to 
accessing alternate content. 

BACKGROUND 

[0002] Many interactive television systems allow television viewers to use their 
televisions to browse hypertext markup language (HTML) content, such as 
Internet websites. However, for some viewers, HTML content displayed on a 
television can be difficult to read, for example, due to poor eyesight. HTML 
includes functionality that allows an HTML developer to include alternate content 
associated with an HTML element. Examples of alternate content include text in a 
large font, or an audio description of an image. Some HTML browser applications 
written for use on computer systems include functionality for accessing alternate 
content, but typically rely on pointing devices, such as a mouse. Unfortunately, 
interactive television systems generally support user interaction through a 
television remote control and do not include a pointing device. As such, 
interactive television systems lack a mechanism for allowing viewers to access 
alternate content in HTML documents. 

SUMMARY 

[0003] Access to alternate content in documents rendered using an interactive 
television viewing system is described. A browser or other rendering engine that 
supports access to alternate content determines which elements in the document 
may receive focus, based on whether or not an accessibility mode is active. When 
an accessibility mode is active, the list of focusable elements may contain 
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elements that, by default, are not focusable elements, but that have associated 
alternate content. An icon or other demarcation, either audio or visual, can be 
used to indicate to the user whether or not an accessibility mode is active. 
Furthermore, an input device, such as a television remote control can be 
configured to provide a mechanism for activating and deactivating an accessibility 
mode. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0004] The same numbers are used throughout the drawings to reference like 
features and components. 

[0005] Figure 1 illustrates an exemplary interactive television system in which 
access to alternate content may be implemented. 

[0006] Figure 2 illustrates select components of a client device implemented to 
support access to alternate content. 

[0007] Figure 3 illustrates an example display of HTML content with an 
accessibility mode inactivated. 

[0008] Figure 4 illustrates an example display of HTML content with an 
accessibility mode activated. 

[0009] Figure 5 illustrates an example display of alternate content associated 
with a text element. 

[0010] Figure 6 illustrates an example display of alternate content associated 
with an image element. 

[0011] Figure 7 illustrates rendering of alternate audio content associated with 
an image element. 
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[0012] Figure 8 illustrates an exemplary method for providing access to 
alternate content. 

[0013] Figure 9 illustrates an exemplary method for rendering alternate content. 
DETAILED DESCRIPTION 

[0014] The following discussion is directed to accessing alternate content 
through an interactive television system. Access to alternate content as described 
herein may be implemented using a browser or other interface or rendering engine 
that renders documents (e.g., HTML or dynamic HTML) that may contain 
elements with associated alternate content. As described, the browser or other 
rendering engine provides a mechanism for accessing alternate content through an 
interactive television system using, for example, a television remote control. 

Exemplary Interactive Television System 
[0015] Figure 1 illustrates an exemplary interactive television system 100, 
which includes client device 102, display device 104, and various input devices 
that interact with the client device. Client device 102 may be implemented in 
many forms, including as a television set-top box, a game console, a satellite 
receiver, a digital video recorder, a television, a personal computer system, a 
cellular telephone, and a personal multi-modal device. 

[0016] Client device 102 includes a wireless receiving port 106 (e.g., an 
infrared (IR) wireless port) for receiving wireless communications from a remote 
control device 108, a handheld device 110 (such as a personal digital assistant 
(PDA) or handheld computer), or other wireless device, such as a wireless 
keyboard. Additionally, a wired keyboard 112 may be coupled to client 
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device 102 for communicating with the client device. In alternate embodiments, 
remote control device 108, handheld device 110, and/or keyboard 112 may us an 
RF communication link (or other mode of transmission) to communicate with 
client device 102. In another alternate embodiment, client device 102, display 
device 104, and an input device may be implemented as a single hardware unit, 
such as a cellular telephone or as a handheld device similar to handheld 
device 110. 

[0017] In the exemplary system described herein, HTML content navigation is 
performed by a user using directional inputs by pressing arrow buttons 114 of 
remote control 108, arrow keys or other inputs associated with handheld 
device 1 10, or arrow keys 1 16 of keyboard 112. Such keys might comprise four 
orthogonal direction keys (up, down, left, and right), or might allow movement in 
additional directions, as with one multi-directional key. For example, by pressing 
the arrow buttons, a viewer can move a colored indicator from one focusable 
element to another. The viewer can select an element, to cause the browser to 
perform some functionality associated with the selected element. For example, by 
pressing a "select" button on remote control 108 while a button associated with an 
HTML document has the focus, causes the browser to perform the functionality 
associated with the button. 

[0018] Users can activate an accessibility mode using an input device, for 
example, by pressing an accessibility button 1 18 on remote control 108. Once in 
the accessibility mode, alternate content can be rendered by focusing on an 
element that has associated alternate content or alternatively, by selecting a 
focused element (e.g., when a viewer presses a "select" button on the remote 
control). 
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[0019] An element may also have multiple instances of associated alternate 
content. For example, an image element may have a first alternate content that 
consists of a textual description of the image, a second alternate content that 
consists of a more detailed textual description of the image, and a third alternate 
content that consists of an audio description of the image. In such an 
implementation, when a user selects an element that has associated alternate 
content, the first alternate content is rendered; pressing the select button a second 
time causes the second alternate content to be rendered; and so on. To support 
elements with multiple instances of alternate content, the television viewing 
system 100 may also include one or more mechanisms that allow a viewer to 
return to the standard element content (i.e., the content associated with an element 
that is displayed when the accessibility mode is not active). For example, while an 
accessibility mode is active, pressing a particular button on remote control 108 
causes the standard image associated with an image element to be displayed 
instead of an associated textual description of the image that may be displayed as 
alternate content associated with the image element. 

[0020] Client device 102 includes a rendering engine for generating a video 
signal and/or an audio signal, both of which are communicated to display 
device 104. The video signals and audio signals can be communicated from client 
device 102 to display device 104 via an RF (radio frequency) link, S-video link, 
composite video link, component video link, or other communication link. 
Although not shown in Figure 1, a particular client device 102 may include one or 
more lights or other indicators identifying the current status of the client device. 
Additionally, a particular client device 102 may include one or more control 
buttons or switches (not shown) for controlling operation of the client device. 
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Exemplary Client Device 
[0021] Figure 2 is a block diagram illustrating select components of a client 
device 102 implemented to support access to alternate content as described herein. 
Client device 102 may be implemented as, but is not limited to, a television set-top 
box, a game console, a satellite receiver, a digital video recorder, a television, a 
personal computer system, a cellular telephone, or a personal multi-modal device. 
[0022] Client device 102 includes a processor 202, a memory 204, a display 
interface 206, an audio output 208, and a video output 210. Operating system 212, 
rendering engine 214, and other applications 216 are stored in memory 204 and 
executed on processor 202. Display interface 206, audio output 208, and video 
output 210 provide mechanisms for client device 102 to communicate documents 
rendered by rendering engine 214 to display device 104. 

[0023] To support alternate content accessibility as described herein, rendering 
engine 214 includes focusable element identifier 218 and content selector 220. 
Focusable element identifier 218 determines, based on whether or not an 
accessibility mode is active, which elements in a document to be rendered are 
focusable. When accessibility mode is active, some elements that, by default, are 
not focusable (e.g., an image element in an HTML document), but which have 
associated alternate content (e.g., a textual or audio description of an image), are 
added to a list of focusable elements. 

[0024] HTML documents are written according to a standard HTML 
specification, such as the HTML4.01 specification, which defines the structure of 
HTML documents, including HTML elements and the various attributes that may 
be associated with each element. In the described implementation, rendering 
engine 214 is configured to render an HTML document according to a standard 
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HTML specification. Accordingly, rendering engine 214 determines which 
elements are focusable when an accessibility mode is inactive based on a list of 
focusable elements derived from the HTML specification. Similarly, rendering 
engine 214 determines which elements are focusable when an accessibility mode 
is active based on attributes associated with each of the elements in a particular 
HTML document. For example, and image element that is not focusable when an 
accessibility mode is inactive may become focusable when the accessibility mode 
is activated if the image element has an associated "alt" attribute used to store a 
short textual description of the image or an associated "longdesc" attribute used to 
store a reference to a long textual description of the image. The "longdesc" 
attribute may also be used to store a reference to other media content, such as an 
audio file that may, for example, provide an audio description of the image with 
which it is associated. 

[0025] Content selector 220 determines which content associated with a 
particular element is to be rendered based on whether or not an accessibility mode 
is active, and in the case where the accessibility mode is active, also based on how 
many times a particular element has been selected. 

[0026] For example, when an accessibility mode is not active for an image 
element, which may have associated alternate content, the image itself is the 
content to be rendered. When the accessibility mode is activated and the image 
element has focus and/or is selected (depending on the implementation), the 
alternate content associated with the image is to be rendered. As described above, 
the alternate content associated with an element is identified according to a 
standard specification associated with the HTML document. Furthermore, an 
element may have multiple instances of associated alternate content. For example, 
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an image may have as alternate content both a textual description of the image and 
an audio description of the image. The content selector 220 is also used to 
determine which of multiple alternate content to be rendered. For example, when 
the element has focus, the first time the element is selected, the first alternate 
content (e.g., a textual description of the image) is rendered; if the element is 
selected a subsequent time, then the second alternate content (e.g., an audio 
description of the image) is rendered. This provides document creators the ability 
to generate documents in which an element can have various levels of alternate 
content to facilitate a wide range of viewer accessibility needs, due to, for 
example, visual or audio impairments of varying degree. The order in which 
alternate content is rendered may be determined based on an attribute order 
specified in the HTML specification. Alternatively, rendering engine 214 may be 
configured to render content associated with alternate content attributes of an 
element according to an alphabetical ordering of the attributes or according to 
another pre-defined ordering of attributes. 

[0027] Alternate content may also be used to direct a user to additional 
documents. For example, when a user selects an element, the associated alternate 
content may be, in and of itself, another document that is rendered in a separate 
browser window. In this case, the viewer may browse the alternate content, which 
may also include links to yet additional documents. To provide an easy way for a 
viewer to return to the originally rendered document, the accessibility button 118 
(or other button on remote control 108) may be configured to cause the interactive 
television system to close any extraneous windows opened as a result of viewing 
alternate content, and return to the display of the original document. 
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Accessing Alternate Content 
[0028] In the described implementation, alternate content such as HTML may 
be accessed when an accessibility mode is active. The default is for the 
accessibility mode to be inactive. 

[0029] Figures 3-8 illustrate example renderings of the following example 
HTML document: 



<!DOCTYPE HTML PUBLIC " -//W3C//DTD HTML 4.01 
Transitional//EN" "http : //www. w3 . org/TR/1999/REC- 
html401-19991224/loose.dtd"> 
<html> 
<head> 

<title>Welcome to the Example.com home page</title> 
</head> <bodyxdiv align= "center" > 

<hlximg src=" titletext ,png" alt = "Welcome to 
Example . com" ></hl> 

<h2>Caring for Injured Animals is Our Passion</h2> 

<form act ion="moreinfo. html "> 
<input type= "submit" value="Click Here to Learn 
More" > 

<img src="injuredpuppy .png" width="160" 
height= n 240" align= "middle" 

alt=" Picture of Injured Puppy" 
1 ongde s c = " puppy de s c . wa v 11 > 
</form> 
< / divx /body > 
</html> 



[0030] Figure 3 illustrates a representative display of an HTML document 300 
when the accessibility mode is inactive, as indicated by icon 302 or other 
demarcation. In an exemplary implementation, if an HTML document does not 
contain elements that have associated alternate content, a different icon or no icon 
at all may be displayed. In an alternate implementation, in addition to displaying 
icon 302, the document rendering system may also (or alternatively) produce an 
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audio indicator when the document is first rendered to indicate that the 
accessibility mode is not active. HMTL document 300 has elements with 
associated alternate content, but the alternate content is not rendered because the 
accessibility mode is not active. The example HTML document 300 includes a 
title text element 304, a second text element 306, a button element 308, and an 
image element 310. A focus indicator 312 is displayed around button element 308 
and indicates that button 308 currently has focus. 

[0031] Figure 4 illustrates the display of HTML document 300 once the 
accessibility mode has been activated. As noted above, the user can activate this 
mode by pressing a dedicated or logically assigned button on an input device. As 
an example, a viewer may have pressed an accessibility mode button 118 on 
remote control 108 to activate the accessibility mode. Icon 402 indicates that the 
document is being rendered in accessibility mode. In addition to, or instead of, 
icon 402, the document rendering system may also produce an audio indicator 
when the document is first rendered or when the accessibility mode is activated to 
indicate that the accessibility mode is active. When accessibility mode is 
activated, elements that are not, by default, focusable, but that have associated 
alternate content, are added to a list of focusable elements that is maintained by 
rendering engine 214 based on the specification associated with the document. In 
the illustrated example, title text element 304 and image element 310 are not 
focusable elements by default, but have associated alternate content, and are thus 
added to a list of focusable elements that includes button element 308. Focus 
indicator 312 indicates that the title text element 304 currently has focus. In an 
exemplary implementation, focus indicator 312 may appear differently if the 
selected element has alternate content. For example, the focus indicator may be 
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rendered using a different color, such as blue rather than yellow, or using a 
different style, such as a dashed line rather than a solid line. If a viewer selects the 
text element that currently has focus (e.g., by pressing a "select" button on the 
remote control), the alternate content associated with the element is rendered. 
[0032] Figure 5 illustrates document 300 after a user moves the focus to an 
element with alternate content. Here, the user selects title text element 304 (as 
described above). Upon selection, the original text (written in a script font) is 
replaced with associated alternate content 502. In this case, the standard content 
text that was rendered using a font that is difficult to read is replaced with the 
alternate content, which in this case, is the same text rendered using a font that is 
easier to read. In an alternate implementation, rather than replacing the standard 
element content with the associated alternate content, the browser may render the 
alternate content in a separate window. 

[0033] Figure 6 illustrates document 300 after a user moves the focus to an 
element with alternate content. Here, the user selects image element 310 (as 
described above). Upon selection, causing alternate content 602 (a textual 
description of the image) associated with image element 310 to be rendered. If 
there is additional alternate content associated with image element 310, then 
selecting the element a second time causes the second alternate content to be 
rendered. 

[0034] Figure 7 illustrates the rendering of additional alternate content 
associated with image element 310. Focus indicator 312 indicates that the image 
element 310 currently has focus. In this example, the second alternate content 
associated with image element 310 consists of an audio description of the image, 
indicated in Figure 7 by text bubble 702. When image element 310 is selected for 
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the second time, the audio description is played, for example, through speakers 
associated with display device 104. 

Method for Providing Access to Alternate Content 
[0035] Access to alternate content may be described in the general context of 
computer-executable instructions, such as application modules, being executed by 
a computer. Generally, application modules include routines, programs, objects, 
components, data structures, etc. that perform particular tasks or implement 
particular abstract data types. Alternate content access may be implemented using 
any number of programming techniques and may be implemented in local 
computing environments or in distributed computing environments where tasks 
are performed by remote processing devices that are linked through various 
communications networks based on any number of communication protocols. In 
such a distributed computing environment, application modules may be located in 
both local and remote computer storage media including memory storage devices. 
[0036] Figure 8 illustrates a method 800 for providing access to alternate 
content associated with elements of a rendered document. For illustrative 
purposes, Figure 8 will be described with reference to components illustrated in 
Figures 1 and 2. 

[0037] At block 802, a browser (or other type of rendering application) receives 
a document to be rendered. 

[0038] At block 804 the browser determines whether or not an accessibility 
mode is active, for example by examining an accessibility flag maintained by the 
browser. Activation of an accessibility mode may be supported by any number of 
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implementations. For example, a user may press an accessibility button 118 on a 
television remote control 108 to toggle into and out of an accessibility mode. 
[0039] If the browser determines that an accessibility mode is not active (the 
"No" branch from block 804), then method 800 continues at block 808, described 
below. On the other hand, if the browser determines that an accessibility mode is 
active (the "Yes" branch from block 804), then at block 806, the focusable element 
identifier 218 alters a list of focusable elements associated with the document by 
adding to the list any elements that have associated alternate content. By default 
the list of focusable elements includes all elements that can, by default, be given 
focus, such as buttons, text entry boxes, and so on. In accessibility mode, the list 
of focusable elements also includes elements that, by default, cannot receive focus 
(e.g., images, plain text, etc.), but that have associated alternate content. By 
including these elements in the list of focusable elements, a viewer is able to set 
the focus to and/or select the element and thereby access the associated alternate 
content. The browser examines the HTML document to identify elements that are 
focusable, based on the HTML specification. When the accessibility mode is 
active, an element may be added to the list of focusable elements if the element 
has an associated alternate content attribute, even if the HTML specification 
indicates that the element is not focusable. 
[0040] At block 808, the browser renders the document. 

[0041] At block 810, the browser monitors viewer input for an accessibility 
mode switch. As indicated by the "No" branch from block 810, the browser 
continues to monitor until an accessibility mode switch indicator is received. 
When the browser receives an indication of an accessibility mode switch, either 
from active to inaction or vice versa, method 800 continues at block 806 (the 
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"Yes" branch from block 810), where the focusable element identifier 218 alters a 
list of focusable elements associated with the document As described above, 
when a viewer switches into (i.e., activates) the accessibility mode, elements that 
are not focusable by default may be added to the list of focusable elements. When 
a viewer switches out of (i.e., deactivates) the accessibility mode, elements that are 
not focusable by default may be removed from the list of focusable elements. 
[0042] Figure 9 illustrates an exemplary method for rendering alternate content 
when the system is in an accessibility mode. 

[0043] At block 902, the rendering engine 214 receives an indication that a 
viewer has selected an element of a rendered document. 

[0044] At block 904, the rendering engine 214 determines whether or not the 
selected element has associated alternate content by examining the attributes of the 
element. If the selected element does not have associated alternate content, then 
the element is, by default, focusable, and is therefore designed to provide some 
functionality when selected. 

[0045] At block 906, when it is determined that the selected element does not 
have associated alternate content (the "No" branch from block 904), the rendering 
engine 214 performs the function that is associated with the element. 
[0046] At block 908, when it is determined that the selected element does have 
associated alternate content (the "Yes" branch from block 904), the content 
selector 220 determines which content associated with the element to render. For 
example, if the element has only one instance of associated alternate content, then 
that alternate content is selected. However, if the element has multiple instances 
of associated alternate content, then the content selector determines which of the 
multiple instances of associated alternate content is most appropriate to be 
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rendered. As described above, in one implementation, the selection is made based 
on the number of times the element has been subsequently selected; for example, 
the first time the element is selected, a first instance of associated alternate content 
is selected; the second time the element is selected, a second instance of associated 
alternate content is selected; and so on. In one implementation, the order in which 
the alternate content is displayed may be based on an attribute order specified in 
the HTML specification. Any number of other techniques may be used to select 
an appropriate instance of associated alternate content. 

[0047] At block 910, the rendering engine 214 renders the selected alternate 
content. In one implementation, the entire document is re-rendered, with the 
alternate content in place of the previously rendered content associated with the 
selected element. Alternatively, only the affected area of the document is re- 
rendered. In another alternate implementation, the alternate content is rendered in 
a new browser window. 

Conclusion 

[0048] Although the systems and methods have been described in language 
specific to structural features and/or methodological steps, it is to be understood 
that the invention defined in the appended claims is not necessarily limited to the 
specific features or steps described. Rather, the specific features and steps are 
disclosed as preferred forms of implementing the claimed invention. 
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